A robotic system based on fuzzy visual servoing for handling flexible sheets lying on a table

Purpose – The purpose of this paper is to present a flexible automation system for the manipulation of fabrics lying on a work table and focuses on the design of a robot control system based on visual servoing and fuzzy logic for handling flexible sheets lying on a table. The main contribution of this paper is that the developed system tolerates deformations that may appear during robot handling of fabrics due to buckling without the need for fabric rigidization. Design/methodology/approach – The vision system, consisting of two cameras, extracts the features that are necessary for handling the fabric despite possible deformations or occlusion from the robotic arm. An intelligent controller based on visual servoing is implemented enabling the robot to handle a variety of fabrics without the need for a mathematical model or complex mathematical/geometrical computations. To enhance its performance, the conventional fuzzy logic controller is tuned through genetic algorithms and an adaptation mechanism and the respective performance is evaluated. The experiments show that the proposed robotic system is flexible enough to handle various fabrics and robust in handling deformations that may change fabric’s shape due to buckling. Findings – The experiments show that the proposed robotic system is flexible enough to handle various fabrics and robust in handling deformations that may change fabric’s shape due to buckling. Research limitations/implications – It is not possible to cover all the aspects of robot handling of flexible materials in this paper, since there are still several related issues requiring solutions. Considering the future research work, the proposed approach can be extended to sew fabrics with curved edges and correcting the distortions presented during robot handling of fabrics. Practical implications – The paper includes implications for robot handling a variety of fabrics with low and medium bending rigidity on a working table. The intent of this paper deals with buckling in context of achieving a successful seam tracking and not the correction strategy against folding or wrinkling problems. Originality/value – This paper fulfils an identified need to study the fabrics’ behavior towards robot handling on a working table.